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Abstract. We say that a set is exhaustible if it admits algorithmic universal quantification 
for continuous predicates in finite time, and searchable if there is an algorithm that, given 
any continuous predicate, either selects an element for which the predicate holds or else 
tells there is no example. The Cantor space of infinite sequences of binary digits is known 
to be searchable. Searchable sets are exhaustible, and we show that the converse also holds 
for sets of hereditarily total elements in the hierarchy of continuous functionals; moreover, 
a selection functional can be constructed uniformly from a quantification functional. We 
prove that searchable sets are closed under intersections with decidable sets, and under 
the formation of computable images and of finite and countably infinite products. This 
is related to the fact, established here, that exhaustible sets are topologically compact. 
We obtain a complete description of exhaustible total sets by developing a computational 
version of a topological Arzela-Ascoli type characterization of compact subsets of function 
spaces. We also show that, in the non-empty case, they are precisely the computable 
images of the Cantor space. The emphasis of this paper is on the theory of exhaustible 
and searchable sets, but we also briefly sketch applications. 



1. Introduction 

A wealth of computational problems of interest have the following form: 

Given a set K and a property p of elements of K, decide whether or not all 
elements of K satisfy p. 
For K fixed in advance, this is equivalent to the emptiness problem for p. One is often 
interested in suitable restrictions on the possible syntactical forms of the predicate p that 
guarantee that this problem is decidable (or, less ambitiously, that the non-emptiness prob- 
lem is semi-decidable) uniformly in the syntactical form of p. In this work, on the other 
hand, the emphasis is on the set K rather than the predicate p, and we study the case in 
which K is infinite. Moreover, p is not assumed to be given syntactically or via any other 
kind of intensional information: we only use information about the input-output relation 
determined by p considered as a boolean-valued function. In the absence of intensional 
information, continuity of p plays a fundamental role, where p is continuous iff for any x 
in the domain of p, the boolean value p{x) depends only on a finite amount of information 
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about x. We work in the realm of higher-type computation with continuous functionals, us- 
ing Ershov-Scott domains to model partial functionals, and Kleene-Kreisel spaces to model 
total functionals [Ml EI] . 

We say that the set K is exhaustible if the above problem can be algorithmically solved 
for any continuous p defined on K, uniformly in p. The uniform dependency on p is 
formulated by giving the algorithm the type (D — > B) — > B, where D is a domain, K C D, 
and B is the domain of booleans. The main question investigated in this work is what kinds 
of infinite sets are exhaustible. 

Clearly, finite sets of computable elements are exhaustible. What may be rather unclear 
is whether there are infinite examples. Intuitively, there can be none: how could one 
possibly check infinitely many cases in finite time? This intuition is correct when K is a 
set of natural numbers: it is a theorem that, in this case, K is exhaustible if and only if it 
is finite. This can be proved by reduction to the halting problem, but there is also a purely 
topological argument (Remark 15. 6p . However, it turns out that there is a rich supply of 
infinite exhaustible sets. A first example, the Cantor space of infinite sequences of binary 
digits, goes back to the 1950's, or even earlier, with the work of Brouwer, as discussed in 
the related-work paragraph below. 

We say that K is searchable if there is an algorithm that, given any continuous pred- 
icate p, either selects some x £ K such that p(x) holds, or else reports that there isn't 
any. It is easy to see that searchable sets are exhaustible. We show that, for sets of total 
elements, the converse also holds and hence the two notions coincide. Moreover, a selection 
functional can be constructed uniformly from a quantification functional (Section EJ). 

We develop tools for systematically building exhaustible and searchable sets, and some 
characterizations, including the following: they are closed under intersections with decidable 
sets, under the formation of computable images and of finite and countably infinite products 
(Section Uj). In the case of exhaustibility, the last claim is restricted to sets of total elements, 
and is open beyond this case. The non-empty exhaustible sets of total elements are precisely 
the computable images of the Cantor space (Section E])- We also formulate and prove an 
Arzela-Ascoli type characterization of exhaustible sets of total elements of function types 
(Section [7J. 

The above closure properties and characterizations resemble those of compactness in 
topology. This is no accident: we show that exhaustible sets of total elements are indeed 
compact, in the Kleene-Kreisel topology (Section EJ). This plays a crucial role in the cor- 
rectness proofs of some of the algorithms, and, indeed, in their very construction. Thus, 
the specifications of all of our algorithms can be understood without much background, 
but an understanding of the working of some of them requires some amount of topology. 
We have organized the presentation so that the algorithms occurring earlier are motivated 
by topology but don't rely on knowledge of topology for their formulation or correctness 
proofs. 

In Section [2] we include background material that can be consulted on demand and in 
Section El we define the central notions investigated in this work. In Section [8] we include 
technical remarks, further work, announcement of results, applications, and research direc- 
tions. In the concluding Section [9] we review the role topology plays in our investigation of 
exhaustible and searchable sets. 
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Related work. Brouwer's Fan functional gives the modulus of uniform continuity of a discrete- 
valued continuous functional on the Cantor space. According to personal communication 
by Dag Normann, computability of the Fan functional was known in the late 1950's. This 
immediately gives rise to the exhaustibility of the Cantor space. A number of authors have 
considered the definability of the Fan functional in various formal systems. Normann [33] 
cites Tait (1958, unpublished), Gandy (around 1982, unpublished) and Berger [7] (1990). 
Tait showed that the Fan functional is not definable from Kleene's schemes S1-S9 inter- 
preted over total functionals. Berger observed that, for partial Junctionals, PCF definability 
coincides with S1-S9 definability, and showed that the Fan functional is PCF definable. In 
order to do that, he first explicitly defined a selection functional for the Cantor space. 
Then Hyland informed the community that Gandy was aware of the PCF/S1-S9 definabil- 
ity of the Fan functional for the partial interpretation of Kleene's schemes, but Gandy's 
construction seems to be lost. 

Acknowledgements. I have benefited from stimulating discussions with, and questions by, 
Andrej Bauer, Ulrich Berger, Dan Ghica, Achim Jung, John Longley, Paulo Oliva, Matthias 
Schroder, and Alex Simpson. I also thank Dag Normann for having answered many ques- 
tions regarding the history and technical ramifications of the subject of higher-type com- 
putation, and for sending me a copy of Tait's unpublished manuscript — but the reader 
should consult his paper [34] for a more accurate and detailed account. 

2. Background 

The material developed here can consulted on demand, except for Section 12.11 which 
introduces and briefly discusses our model of computation. Some readers will be more fa- 
miliar with domain theory and Ershov-Scott continuous functionals (and PCF or functional 
programming) via denotational semantics, and others with the Kleene-Kreisel continuous 
functionals via higher-type computability theory, and we consider these two models and their 
relationship [33]- Alternatively, we could have worked with Weihrauch's model of computa- 
tion via representations [46 j . which generalizes Kleene's approach via associates |31j . Even 
better, we could have worked with the QCB model of computation, which subsumes both 
domain theory and representation theory in a natural way [3,13]. We adopt the Ershov-Scott 
and Kleene-Kreisel approaches as they have played a wide role [33] • A presentation based 
on QCB spaces would have been not only more general but also cleaner in several ways, 
but less familiar and perhaps more technically demanding. Our objective in this paper is to 
address the essential issues without getting distracted by an excessive amount of generality. 

2.1. Domains of computation. We work on a cartesian closed category of computable 
maps of effectively given domains that contains the flat domains of booleans, 

B = {0,1,1.}, 

and of natural numbers, 

A/" = NU{J_}, 

such as [T7] or [33] among other possibilities. Notice that these categories are closed under 
countable cartesian powers. We don't need to, and we don't, explicitly refer to effective 
presentations, and in particular to numberings of finite elements or abstract bases etc. to for- 
mulate computability results. We instead start from well known computable functions and 
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use the fact that computable functions are closed under definition by lambda abstraction, 
application, least fixed points etc. Moreover, we don't invoke non-sequential functions such 
as Platek's parallel-or [UJ or Plotkin's parallel-exists [35] in order to construct new com- 
putable functions. Our algorithms can thus be directly understood as functional programs 
in e.g. PCF [35], FPC [37] (PCF extended with recursive types, interpreted as solutions of 
domain equations) or practical versions of FPC such as Haskell \12\ I25j. as done in |19j . 

At some point we need further assumptions on our domains of computation to be 
able to formulate and prove certain results. Some of those results can be formulated, and 
perhaps also be proved, for domains with totality in the sense of Berger [8]. We consider 
the particular case consisting of the smallest collection of domains containing B and M and 
closed under finite products, countable powers and exponentials (=function spaces). 

2.2. Higher-type computation. The remainder of this section is not needed until The- 
orem 14.91 As discussed in e.g. [Ml ESI ED], there are many approaches to higher-type 
computation. Kleene defined the total functionals directly, but it has been found more con- 
venient to work with the larger collection of partial functionals and isolate the total ones 
within them, as done by Kreisel. The approaches are equivalent, and such total functionals 
are often referred to as Kleene-Kreisel functionals or continuous functionals. It turns out 
that, as discussed by Normann [34], this coincides with another approach that also arises 
programming language semantics: equivalence classes of total functionals on Ershov-Scott 
domains. We work with both total functionals on domains and a characterization of the 
Kleene-Kreisel functionals, due to Hyland, in terms of compactly generated spaces. 

Types. The simple types are defined by induction as 

a, t ::= o \ l \ a x t \ a — ► t, 

where o and t are ground types for booleans and natural numbers respectively. The subset 
of pure types is defined by 

a ::= t \ a — »■ i. 

As usual, we'll occasionally reduce statements about simple types to statements about pure 
types. 

Partial functionals. For each type <r, define a domain D a of partial functionals of type a by 
induction as follows: 

D a = B, A = AT, 

D a ^ T = (D a -> D T ) = D T D ° 

where the products and exponentials are calculated in the cartesian closed category of 
continuous maps of Scott domains, where a Scott domain is an algebraic, bounded complete, 
and directed complete poset [JJ. 
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Total functionals. For each type a, define a set T a C D a of total Junctionals and a rela- 
tion on Dq- as follows, where 7 ranges over the ground types o and 1: 

T Q = 2 = {0, 1}, T L = N, x ~ 7 y <^=> x,y G T 7 A x 



y- 



T 



, =T a xT T , (x, x') ~«t (y, 2/') x ~ CT 2/ A x' ~ T y', 

^-►t = {/ G At^t I /(r CT ) C T T }, / ~ CT ^ T g <=4> Vx ~ CT y./(x) ~ T y(y). 

Then the set T a can be recovered from the relation ~ cr as 

x G x ~o 

and the relation can be recovered from the set as 
x ~o y x n y G To 

-4=^ x, y G To and x and y are bounded above. 
See e.g. [8] and [38]. In particular, ~ CT is an equivalence relation on T a . 

Computability. Plotkin [35] characterized the computable partial functionals as those that 
are PCF-definable from parallel-or and parallel-exists [35]. All computable functionals we 
construct from Section [6] onwards are defined in PCF without parallel extensions. This 
characterization of computability includes, in particular, total functionals. An interesting 
fact, which we don't need to invoke, is that every total functional definable in PCF with 
parallel extensions is equivalent to one definable in PCF without parallel extensions [32J. 



2.3. Kleene Kreisel functionals. For each type a, define by induction a set C a of 
Kleene-Kreisel functionals of type a and a surjection p a : T a — > C a as follows, so that 

Co- = T a / ~o . 

For ground types and product types, define 

C = 2 = T , C L = N = T, 

Co-XT = C a x C T , 

For function types, consider the diagram 

Do * d To ■ 



Pj(x) = X. 

Pa XT = Pa x Pr- 



(t) / 



(1) 



+ 

~3 T T 



Pa 



(2) 



Pi 



Co 



+ 

C T . 



The square (1) commutes for some map T a — ► T T if and only if / G T a ^ T , and in this case 
the map is uniquely determined as the (co)restriction of /. Moreover, in this case, there is 
a unique map <p making the square (2) commute, because p a is a surjection. We define 

Co^t = {0: Co — ► C T I 3/ G Tow T .(2) commutes}, 

Po—>r(f) = the unique (j> such that (f) commutes. 

Then, by construction, for any a and all x,y G D a , we have that 

x ~o y iff x, y G To and p a {x) = p a {y). 



6 



M. ESCARDO 



If (f) commutes, we say that / is a representative of eft. A Kleene-Kreisel functional is 
computable iff it has a computable representative. 

Lemma 2.1. Every C a is a computable retract of C r _* t for some r. 

A stronger form of this is known as "simple types are retracts of pure types" (see 
e.g. [30]). Here we use the fact that every pure type is either t or of the form r — > l, and 
that l is a retract of t — > i for any r. 

2.4. Compactly generated spaces. The remainder of this section is not needed until 
Section El where it is used in order to formulate and prove the crucial Lemma 15.51 that es- 
tablishes compactness of exhaustible sets of total elements. Compactly generated Hausdorff 
spaces, or /c-spaces, to be introduced shortly, are to total computation as Scott domains 
are to partial computation. This becomes clear in Section 12.51 Here we briefly introduce 
/c-spaces and some of their fundamental topological properties that are applied to prove 
various computational theorems. For more details and proofs, see e.g. [21J or the references 
contained therein. 

We begin by considering the Hausdorff case. If F is a closed set of a Hausdorff space X, 
then K n F is closed for every compact set K C X. Any set F that satisfies this condition 
is called /c-closed. The Hausdorff space A is a k-space iff every /c-closed set is closed. (This 
is equivalent to saying that X is the colimit of its compact subspaces ordered by inclusion.) 
Any Hausdorff space can be transformed into a /c-space by stipulating that all /c-closed 
sets are closed. In categorical terms, this construction is a coreflection of the category of 
Hausdorff spaces into its subcategory of /c-spaces. 

The category of Hausdorff /c-spaces is cartesian closed. Given objects X and Y, their 
categorical product X x Y is the coreflection of their topological product. Their exponential 
Y x consists of the continuous maps X — > Y under the coreflection of the compact-open 
topology. The compact-open topology has subbasic open sets of the form 

N(K,V) = {f GY X \f(K)CV}, 

where K is a compact subset of X and V is an open subset of V. Cartesian closedness 
amounts to the fact that the evaluation map 

Y x x X -» Y 

(f,x) h-» f(x) 

is continuous, and that for any continuous map / : Z x X — > Y, its transpose 

f:Z -> Y x 

Z I ► (ih f(z, x)) 

is continuous. Equivalently, / is continuous iff / is continuous. 

We also need to consider /c-spaces without the restriction to the Hausdorff case. Let 
X be an arbitrary topological space. A probe is a continuous function p: K — > X where 
K is a compact Hausdorff space. A set F C X is /c-closed if p~ 1 (F) is closed for every 
probe p: K — ► X. Then, again, A is a /c-space iff every /c-closed set is closed, and k- 
spaces form a cartesian closed category, and the inclusion of Hausdorff /c-spaces preserves 
products and exponentials. All locally compact spaces are /c-spaces, and this includes non- 
Hausdorff examples such as Scott domains under the Scott topology. The description of the 
products and exponentials in the general case is omitted and the reader is referred to the 
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above references, but in any case they are not needed for the purposes of this work, with 
one exception: an exponential of fc-spaces whose base is the Sierpinski space has the Scott 
topology [21 j . This is applied in the proof of the following lemma. 

Denote by S the Sierpinski space with an isolated point T and a limit point _L. This 
is the same as the domain {_L,T} under the Scott topology. For any topological space X, 
a function p: X — > S is continuous iff p _1 (T) is open, and a set U C X is open iff its 
characteristic function xu, defined by xu{x) = T <J=^ x £ U, is continuous. Thus, using 
the Sierpinski space, the notion of openness is reduced to that of continuity. The following 
reduces the notion of compactness to that of continuity (a particular case of this is proved 
in [18] , with essentially the same proof as the one give here) . 

Lemma 2.2. If X is a k- space, a set K C X is compact if and only if the universal 
quantification functional \/k '■ S x — > S defined by 

^k{p) = T iff p{x) = T for all x G K 
is continuous. 

Proof. A set K is compact if and only if every directed cover of K by open sets has a 
member that covers K, because from any cover one obtains a directed cover with the same 
union by adding the finite unions of the members of the cover. Hence by definition of the 
Scott topology, a set is compact if and only if its open-neighbourhood filter is open in the 
Scott topology of the lattice of open sets. But U i— ► xu is a bijection from the lattice of open 
sets to the points of S , and it was shown in [21] that the topology of the exponential S x is 
the one induced by this bijection. Hence the functional Mk is continuous iff V^ : 1 (T) is open 
iff the set of characteristic functions xu with K C U is open iff the open neighbourhood 
filter of K is open iff K is compact. □ 



2.5. Hyland's characterization of the Kleene Kreisel functionals. For certain con- 
structions and proofs of algorithms, we consider a topology on the set of Kleene-Kreisel 
functionals. 

Definition 2.3. Endow T CT with the relative Scott topology and C a with the quotient 
topology of the surjection /v : T CT — > C a . We refer to this topology on C a as the Kleene- 
Kreisel topology, and to the resulting spaces C a as the Kleene-Kreisel spaces. The points of 
the Kleene-Kreisel spaces are often referred to as the continuous functionals in the higher- 
type computability (or higher-type recursion) literature. □ 

A proof of the following inductive topological characterization of the Kleene-Kreisel 
spaces, attributed to Hyland, can be found in Normann [31] . 

Lemma 2.4. With products and exponentials in the category of Hausdorff k-spaces, 

(1) C 7 has the discrete topology for 7 ground, 

(2) Co-xt- = C a x C T and 

(3) Co-— yt = C T a . 

The following two lemmas, which are part of the folklore of the subject, are applied 
in order to show that exhaustible sets of total elements are compact in the Kleene-Kreisel 
topology (Lemma 15. 5t [T|)). A set is called clopen if it is both closed and open. 

Lemma 2.5. For every clopen U C C a there is a total predicate p £ (D a — > B) such that 
p-\U) C p-!(l) and p-\C a \ U) C p-^O). 
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Proof. Because U is clopen, its characteristic function xu ■ C a — > 2 is continuous, and hence 
so is the composite i o \u ° Pa'- T a — ► 2?, where z : 2 — > $ in the inclusion. Because T is dense 
in D a (see e.g. [8]) and because Scott domains, and hence B, are densely injective (see e.g. 
[23]), by definition of injectivity this extends to a continuous function p: D a — ► Then p 
is total by construction, and the extension property amounts to the above set inclusions. □ 

A space is zero- dimensional iff it has a base of clopen sets. The zero- dimensional 
reflection ZC of a space C is obtained by taking the same set of points and the clopen sets 
as a base. 

Lemma 2.6. ZC a and C a have the same compact subsets. 

Proof. We first show that 1CZC = C where C = C a and /C is the coreflector into the 
category of fc-spaces. The property KZC = C is easily seen to be inherited by retracts, 
and hence, by Lemma l2.lt it is enough to consider a = r — ► l, and hence C = N Y for some 
fc-space Y. Exponentials in /c-spaces are given by the fc-coreflection of the compact-open 
topology on the set of continuous maps. When the target is N, the compact-open topology 
is clearly zero-dimensional and Hausdorff. Now, it is easy to see that KLZC = C iff there is 
some zero-dimensional topology whose /c-reflection is C, and hence we are done. The result 
then follows from the well-known fact that a Hausdorff space has the same compact sets as 
its fc-coreflection. □ 

If the spaces C a were zero-dimensional, the above lemma would be superfluous. But 
Matthias Schroder [39] has recently shown, after this paper was produced and refereed, that 
the spaces C a are not zero-dimensional, and in fact not even regular, answering a question 

of [a S3]- 



3. Exhaustible and searchable sets 

We now formulate the central notions investigated in this work. 

Definition 3.1. if K is a subset of the domain D, we say that a predicate p € (D — > B) is 
defined on K if p(x) ^ _L for every x G K. □ 

Definition 3.2. We say that a subset K of the domain D is exhaustible if there is a 
computable functional Vx : (D — > B) — > B such that for any p G (D — > B) defined on K, 



Vjc(p) 



1 if p(x) = 1 for all x <E K, 
if p(x) = for some x € K. 

Such a universal quantification functional is not uniquely determined, because its behaviour 
is not specified for predicates p that are not defined on K. For the sake of clarity, we'll 
often write "V^(Ax. . . . )" as "Vx G K. . . . ". □ 

Clearly, it is equivalent to instead require the existence of a computable functional 
3k '■ iP — > B) — > B such that for any p G (D — > B) defined on K, 



1 if p(x) = 1 for some x G K, 
if p(x) = for all x G K, 



because such functionals are inter-definable by the De Morgan Laws and hence we'll freely 
switch between them. 
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We now formulate searchability in a way slightly different from that of the introduction, 
which is more convenient for our purposes. The only essential difference is that the present, 
official definition excludes the empty set (cf. Remark [33]). 

Definition 3.3. We say that a set K C D is searchable if there is a computable functional 
ek '■ (D — > B) — > D such that, for every predicate p G (D — > B) defined on K, 

(1) e K {p) G if, and 

(2) p{sk{p)) = 1 if = 1 for some x € K. 

Again, notice that the selection functional ek is not uniquely determined by K. O 

Thus, ek{p) is an example of an element of K for which p holds, if such an element 
exists, or a counter-example in K if no such example exists. 

Lemma 3.4. Searchable sets are exhaustible. 

Proof. Define 3r(p) = p{^k(p))- D 

The empty set is exhaustible with ^%{p) = 1, but it is not searchable because the 
condition £${p) G cannot hold. But we'll see in Section [6] that, under fairly general and 
natural conditions, the two notions turn out to agree in the non-empty case. Moreover, it is 
clear that non-empty finite sets of computable elements are both exhaustible and searchable. 

Remark 3.5. With 1 = {*}, an equivalent definition of searchability is that 

(1) K has a computable element ex, and 

(2) there is e' K : (D — > B) — > 1 + D computable such that e' K (p) = * if there is no 
example, and otherwise e' K {p) G K and p(e' K (p)) = 1. 

In fact, given ek one can define ex = £k(^x.1) and 

£ 'k(p) =if p(£k(p)) then £ K (p) else *. 
Conversely, given e' K and ex as specified, one can define 

£k(p) =if £'k(p) = * then ex else e'k{p)- 

□ 

Regarding examples, we'll deduce later the known fact that the Cantor space is search- 
able. For the moment, we show that the natural numbers with a point at infinity form a 
searchable set. 

Definition 3.6. The one-point compactification of the natural numbers is the subspace 
Nqo of the Cantor space 2 U C B w consisting of the sequences Q 11 !^ (representing natural 
numbers n) and W (representing the added point at infinity). □ 

The relative Scott topology on the Cantor space agrees with the product topology of 
the discrete space 2, but such topological considerations are not needed until Section [5j In 
constructive mathematics, is equivalently defined as the set of sequences q£2 u with 
cti < a^+i, to avoid excluded middle. In functional programming, Nqo also arises as the set 
of maximal elements of the domain of lazy natural numbers. 

Example 3.7. N oo is searchable, with selection functional £Noo defined by primitive recur- 
sion as 

£N oo (p)« = 3n<i.p(0"l-). 

Notice that £Noo(p) is the infimum of the set of solutions a G Nqo of p(a) = 1, including the 
case in which the set is empty, for which (p) = oo. fj 
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This construction is implicit in Exercise 1 of Barendregt [2, Page 581], attributed to 
Kreisel. The point of that exercise is that this algorithm can be interpreted as a functional 
in the full type hierarchy, defined in Godel's system T, that also works for discontinuous p. 
The exercise uses this to prove that the substructure of definable elements is not extensional, 
or equivalently, that the set-theoretical model of system T fails to be fully abstract. This 
exercise was brought to my attention by Gordon Plotkin and Alex Simpson, after I posed 
this full abstraction question to them. Notice that the Kleene-Kreisel model of system T 
is fully abstract, using the fact that the elements of a dense set are definable. 

4. Building new searchable sets from old 

In this section we develop algorithms that don't require knowledge of topology but 
are motivated by topological considerations. Starting from the finite sets, the algorithms 
allow us to systematically build plenty of infinite searchable sets. The intuition behind the 
topological notion of compactness is that compact sets behave, in many relevant respects, 
as if they were finite. Infinite sets that admit exhaustive search in finite time share the same 
intuition. Hence it is natural to conjecture that they also share similar structural properties. 
For example, compact sets are closed under the formation of products (Tychonoff theorem). 
Motivated by this, in this section we show that searchable sets are closed under countable 
products, and we also export other closure properties from topology to computation. 

Definition 4.1. For a given set K C D, we say that a set F C K is decidable on K if 
there is a computable map ipF'- D — > B defined on K such that, for all x G K, iPf(x) = 1 
iff x G F. □ 

Proposition 4.2. Let K C D and let F C K be decidable on K. 

(1) If K is exhaustible then so is K n F. 

(2) If K is searchable then so is K(~)F, provided it is non-empty. 
Proof. Define 

^kdf(p) = 3x G K.x G F A p(x), 

£KnF(p) = if 3x G K. x G F A p(x) then sk(Xx.x G F A p{x)) else ex(Ax.x G F). □ 

The topological motivation for the above proposition is that the intersection of a closed 
set with a compact set is compact. Decidable sets correspond to sets that are open and 
closed, and hence, bearing in mind that exhaustible sets (ought to) correspond to compact 
sets, the above proposition ought to be true, which it is. It is an easy exercise to show that 
exhaustible and searchable sets are closed under binary unions. But binary intersections 
are problematic. In fact, in topology, in the absence of assumptions such as the Hausdorff 
separation axiom, compact sets fail to be closed under binary intersections. Hence any 
algorithm for binary intersections would have to exploit specialized topological and/or order- 
theoretic properties of domains. The topological motivation for the following proposition 
is that, in topology, continuous images of compact sets are compact. In fact, it arises by 
replacing continuity by computability and compactness by exhaustibility. 

Proposition 4.3. Exhaustible and searchable sets are closed under the formation of com- 
putable images. 
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Proof. Let / G (D — > Z)') be computable and let X be a subset of -D. For any quantification 
functional Vk : (-D — > S) — > *8, the functional Vynn : B) ^ B defined by 

V/ ( jo(<z)=Vsetf. ?(/(*)) 

is clearly a quantification functional for f(K). 

For any selection functional : (-D — > S) — > D, the following definition gives a selection 
functional £/(#) : (D — > B) — » £>: 

That is, first find x such that q(f(x)) holds, using ek, and then apply / to this x. O 

The following corresponds to the fact that compact sets in topology are closed under 
finite products: 

Proposition 4.4. Exhaustible and searchable sets are closed under the formation of finite 
products. 

Proof. For K C D and K' C D' exhaustible, define 

\/ KxK ,(p) = Vx € K.Vx' G K'.p(x,x'). 

For K Q D and if C £)' searchable, to compute £kxK'(p) we first find x £ K such that 
there is x' G X' with p(x,x'), and then find x' € X' such that p(x,x'), i.e. 

x = £ft-(Ax.3x' G K' .p(x,x')), 

x' = 6k'(\x' .p(x, x')), 

using the fact that searchable sets are exhaustible, and let £kxK'(p) = (x,x'). □ 

Compact sets in topology are closed under arbitrary products. We now show that 
searchable sets are closed under countable products. We would like to show that for any 
sequence of searchable sets Ki C Dj, their product \\ i Ki C is a l so searchable, 

but this would require dependent types, which are not part of the traditional higher- type 
computation formalism (but see [10] and [9]). So we assume that the components Ki of the 
product are all subsets of the same domain D, so that f] i Ki C D w instead, leaving the 
more general question for future work. 

Given selection functionals 

B) - £>), 

we wish to construct a selection functional 

e UiKi e((D»^B)^D«). 
The idea, which iterates the proof of Proposition 14.41 is to let 

£ lliKi(P) = x Q x l x 2 ■ ■ -x n . . . , 

where 

xo G Kq is such that 3a G Y\ i Ki + i.p(xoa), 
x\ G K\ is such that 3a G Y\ { Ki + 2-p(xoX\a), 

x n £ K n is such that 3a G Y\ { Ki +n+ \.p(xQXi . . . x n a), 
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The component x n will be found using £K n , and existential quantifications will be recursively 
reduced to search. To make this precise, we change notation. Given a sequence 

such that £j is a selection functional for ifj, we wish to find 

H(e) G (D w ^B)^D" 

that is a selection functional for Y\ i Ki. That is, we are looking for a computable functional 

II: ((D ^B)^ D) u -> ((IT ^B)^ D") 

that transforms any sequence of selection functionals for subsets of D into a selection func- 
tional for a subset of D w : 

II(e)(p)(n) = x n such that 3a G JJ if j+ n _|_i .p(a:oa;i . . . x n a). 

i 

To complete the derivation of the functional II, we reduce the existential quantification to 
a suitable recursive call to II. If the functional II is to meet its specification, n(Ai.£j+ n +i) 
should be a selection functional for the set Y\ j K i+ n +i . But a searchable set is exhaustible 
by Lemma f3. 41 To implement the proof of this lemma in our situation, for any given p, n, x n , 
define 

Pn,x n (a) = p(xqXi . . . x n _ix n a) 

= p(n(e)(p)(0) * H(e)(p)(l) * . . . *n(e)(p)(n - 1) * x n * a). 

For the sake of clarity, here we have used "*" , rather than juxtaposition as above, to indicate 
concatenation of elements and sequences. Then 

3a G K i+n+ i.p(x xi . . 

i 

is equivalent to 

Pn,x n (II( \i.£ n+i+ i ) (p n>Xn ) ) . 

To find x n such that this holds, we use e n : 

II(e)(p)(n) = e n {Xx n .p niXn (n(Xi.e n+ i +1 )(p niXn ))). 

Because we don't want a different variable x n for each n, we rename the variable to simply x. 
This completes our derivation of the product functional: 

Definition 4.5. The product functional II: {(D -» B) -> L>) w -» ((L> w -» B) -» D w ) is 
recursively defined by 

n(E)(p)(n) = e r ^-Pn, X ,e(^ {n+1) )(Pn,x,e))) 

where 

/ fn(e)(p)(») ifi<n, 

Pn,x,e( a ) =P Xi.lx if i = n, 

\ [«i- n -i ifi>n, 

and where for any sequence (3 we write j3^ to denote the sequence j3 with the first k 
elements removed: 

fli^ = Pk+i- 
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For future use, we also write j3' = /3^' and 
so that 



Pn,x,e( a ) = P( n ( £ )(p)( n ) *X*a). 

□ 



The original proof of the following theorem, sketched in [19] , uses an auxiliary recurrence 
relation and dependent choices. The following more elegant proof, based on alternative 
recurrences and bar induction, was presented to me by Ulrich Berger and is included with 
his permission: 

Theorem 4.6. If each £{ is a selection functional for a set Ki C D then 11(e) is a selection 
functional for the set JX 2Q C D u . 

Proof. Define 

p x (a) = p(x*a), 
x £ , p = n(e)(p)(0) = e (\x. Px (U(e')(p x ))), 

Pe = Px s , p = P0,x £tP ,e- 

Claim: 

(1) (n) Pn+l,x,e = (.Pe)n,x,e', 

(2) (n) U(e)(p)(n + l)=U(e')(p £ )(n), 

(3) n(e)(p)=x E)P *n(e , )(p £ ). 

We prove the properties (l)(n) and (2)(n) simultaneously by course of values induction. 
Proof of (l)(n) assuming (2)(fc) /or a// fc < n: By the assumption, 



n(e)(p)(n+l) = n(e)(p)(0)*(n(e)(p)(l),...,n(e)(p)(n)) 
= x £ , p * (n(e')(p £ )(0), ...,n(e')(p £ )(n - 1)) 
= x £iP *n(e')(p e )(n). 



Hence 



Pn+M,e( a ) = p(n(e)(p)(n + 1) * x * a) 

= p(x £tP *IL(e')(p £ )(n) * x * a) 
= p £ (Ii(e'){p £ )(n) * x * a) 

= (Pe)n,x,e'(pi). 

Proof of (2)(n) assuming (l)(n): 

II(e)(p)(n + 1) = e n+ i(Ax (II(e("+ 2 ))(p„ +M , £ ))) 

= e;(Ax.(p £ ) ni:Ei£ ,(n(e^ +1 )((p e ) ni:Cie ))) 

= H(e')(p £ )(n). 

Proof of (3): We have (n(e)(p))' = n(e')(f> £ ) by (2), and hence 

n(e)(p) = n(e)(p)(0) * (n(e)(p))' = x £ , p * n(e')b £ ). 

This completes the proof of the claim. 

For a subset L of a domain 22 and g: 2? — > B defined on L, say that an element x £ L 
solves q over L if g(x) ^ _L, and g(x) = 1 provided q(y) = 1 for some y £ L. Then 
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5: (E — > B) — > is a selection function for L iff 5(g) solves g over L for every g defined 
on L. Define the proposition S(p, Y\ { Ki) by 



We need to show that if p is defined on Y\ { Ki then S(p, JJj -fQ) holds. The set of continuous 
predicates p defined on FJ i ATj can be defined as follows by bar induction: 

(1) if p(J-) 7^ _L then p is defined on Y\ i Ki, and 

(2) if p x is defined on FJ i for all x € ifo then p is defined on Y\ i K^. 
Therefore, it suffices to show that for all p G (D w — > $), 

(i) if p(±) ^ J_ then S(p,n^i), and 

(ii) if S(p x , n, AT m ) for all x G tf then S(p, Ui Ki). 

Proof of (i): Let b = p(-L) and assume that b ^ _!_. Then p = Aa.ft, by monotonicity 
of p. Let Si be a selection function for Ki. Then 11(e) (p)(n) = e n (Xx.b). Since Ax. 6 is 
defined on K n , it follows that e n {\x.b) G K n . Hence II(e)(p) G IL^i- Hp(a) = 1 for some 
a e Tlj K-i then p = Aa.l and hence p(H(e)(p)) = 1. 

Proof of (ii): Assume the bar induction hypothesis 



Proof of (ii)(a): We show that II(e)(p)(n) G K n by induction on n. 

Base case for (ii)(a): 11(e) (p)(0) = x £tP = eo(\x.p x (TL(e')(p x )))- Since e- is a selection 
function for -fQ+i, it follows from (f) that H(e')(p x ) solves p x over []; for all x G Kq. 
Then \x.p x {Ii{e ! ){p x )) is defined on Kq, and since eo is a selection function for Kq, it follows 
that n(e)(p)(0) G iT . 

Induction step for (ii)(a): 11(e) (p)(n + 1) = n(e')(p £n ) = IL(s')(p Xep )(n) G K n+ i by 
Claim (2), by (t) and by the fact that x £ , p = 11(e) (p)(0) G Kq (base case). 

Proof of (ii)(b): Assume p(a) = 1 for some a G Ki. Then a' G J^i ^i+l an d PooC^O = 1) 
and, by (f), we have S(p ao , n« ^i+l)- Since e' is a selection function for Y\ i -fQ+i, it follows 

that n(e')(p ao ) G Ili^+l and Pa (H( e O(Pao)) = L Then P£( n ( e ')(Pe)) = 1 because e 
is a selection function for Kq. But p e (n(e')(p e )) = p(x £jP * IL(e')(p £ )) = p(II(e)(p)), by 
Claim (3). ' □ 

Examples 4.7. 

(1) The Cantor space 2 W C i3 w is searchable. A selection functional is given by II(Az.e2) 
where £2 is a selection functional for the finite set 2 C B. 

(2) If Ki C N is a sequence of finite sets that are finitely enumerable uniformly in i, 
then Y\ i Ki C AA^ is searchable, again using the product functional. 

If a product Y\i Ki is searchable, then each set K n is searchable uniformly in n, by Propo- 
sition 14.31 as it is the computable image of Y\i Ki under the n-th projection. □ 




11(e) (p) solves p over Y\ { Ki whenever e, is a 
selection functional for Ki. 



(t) Sfe.n^m) for all xeK . 
We need to show that if ej is a selection function for Ki then: 
(ii)(a) n( £ )(p)Gn^i. 

(ii) (b) If p(a) = 1 for some a G Hi^i) then p(U(e)(p)) = 1. 
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Remark 4.8. Berger's selection algorithm e: (B u — > — > £J a ' for the Cantor space, men- 
tioned in the introduction, can be written as 



e(p) 



* e(A<xp(0 * a)) if p(0 * e(Xa.p(0 * a))), 

1 * e(\a.p(l * a)) otherwise. 

If one defines 3 : (B w — ► B) — > B by 3(p) = p(e(p)), as in the proof of Lemma EU then the 
above definition is equivalent to 

* e(Xa.p(0 * a)) if 3a.p(0 * a), 

1 * e(\a.p(l * a)) otherwise. 

Our product algorithm is inspired by this idea. □ 



e(p) 



From now on, we rely on Section 12.21 for the definition of totality. By Lemma [37 
above and by Theorem 16.31 below, a non-empty set of total elements is exhaustible iff 
it is searchable, and hence the above theorem shows that non-empty, exhaustible sets of 
total elements are closed under countable products. For Sierpinski-valued, rather than 
boolean- valued, universal quantification functionals, a countable-product algorithm is given 
in [18], but we don't know how to approach countable products of boolean- valued quantifiers 
without the detour via selection functionals at the time of writing. 

We now derive a uniform continuity principle from Theorem 14.61 motivated by topo- 
logical theorems that assert that, in certain contexts, continuous functions are uniformly 
continuous on compact sets. Define 



a = n f3 -4=> a,i = Pi for all i < n, a 



\n\ 



i < n, 
otherwise. 



Then a = n (3 iff a\ n = (3\ n . 

Theorem 4.9. If f € {D u — > J\f) is defined on a product ]~J i Ki of searchable sets, then 
there is a number n such that for all a, a' G YliKi, 

a = n cJ => f(a) = f(a'). 

Proof. Let (==) G (AT x TV — > B) be the unique total function such that (x == y) = 1 iff 
x ~ y. Then Vp^. ^(Xa.f^a) == f(a)) = 1. If we define 

f\n(a) = f(a\ n ), 

then / = \Jnf\n and hence (Xa.f(a) == /(a)) = \Jn( Xa -f\n(a) == /(«))• So, by continu- 
ity of Vr^ Ki i there is n such that 

V]Ji Ki( Xa -f\n( a ) == /(«)) = L 
We cannot conclude that f\ n (a) == f(a) for all a G Y\ i Ki because there is no reason 
why the predicate \a.f\ n (a) == /(a) should be defined on Hi-^i- To overcome this 
difficulty, let j3 G Ki+n and define g n (a) = f{a^a\ . . . a n -i(3) so that g n is defined 
on Y\_i Ki and above f n . By monotonicity, Vrr. Ki(^ a -9n(ct) == f(ct)) = 1. Now the predicate 
\a.g n (a) == /(a) is defined on Y\ i Ki and hence g n (ct) = f(a) for all a G Ili-^- But if 
a = n a' then g n (a) = g n (a'), and so f(a) = f(a'), as required. □ 
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The following is an immediate consequence of this and Theorem 14.61 
Corollary 4.10. The functional fan = fanj-j. x 4 : (D u — > M) — > A/" defined by 

fan(/) = /zn.Va, € JJ a = n => /(a) = /(/?) 

i 

is computable uniformly in any sequence of selection functionals for the sets Ki C D, and is 
defined on any f that is defined on \\ i K{. Moreover, if the sets Ki consist of total elements 
of a domain D = D a , then the fan functional is total. 

This holds, in particular, if D = M and each Ki is a finite subset of N defined uniformly 
in i, which is the case that has been considered in higher-type computability theory regard- 
ing the fan functional (see e.g. [23] ). Here we have generalized this to arbitrary higher types 
D = D a . A consequence of the exhaustibility of the Cantor space is that: 

Corollary 4.11. The total elements of the function space (B u — * TV) have decidable equiv- 
alence. 

Proof. The algorithm (==) : (B* -► AO X (ff" -»■ AO -»■ B given by 

(/ == s)=Va€2 w ./(a) ==<?(«) 

does the job. □ 

This can be generalized as follows, where we now rely on Section [2.31 for the definition 
of the Kleene-Kreisel spaces C a . 

Definition 4.12. The discrete and compact types are inductively defined as 

discrete ::= o | i | discrete x discrete | compact — > discrete, 

compact ::= o \ compact x compact | discrete — > compact. 

The reason for this terminology is that the space C a is discrete if a is discrete, and it is 
compact if a is compact, as observed in [18]. □ 

Theorem 4.13. 

(1) If a is discrete, then C a is computably enumerable. 

(2) The total elements of a domain of compact type form a searchable set. 

(3) The total elements of a domain of discrete type have decidable equivalence. 

Proof. By induction on the definitions of discrete and compact type. The first condition 
holds by the Kleene-Kreisel density theorem, which gives a computable dense sequence 
of C a , and by the fact that C a is discrete. For the second condition, use Theorem 14.61 with 
the aid of the first condition, and, for the third one, use the argument of Corollary 14.111 fj 

We conclude this section with a natural notion that plays a fundamental role in our 
investigation of exhaustible and searchable sets and their relationship. Let D = D a and 
D' = D a i for types a and a'. 



Definition 4.14. We say that a set K C D is entire if it consists of total elements and is 
closed under total equivalence. □ 



EXHAUSTIBLE SETS 



17 



Notice that if p is total then it is defined on every entire set. If p is not total and K 
is not entire, but if p is defined on K, then p(x) = p(x') for all x ~ x' in K, because if 
x ~ x' then x and x' are bounded above and hence so are p(x) and p(x'), which then must 
be equal as they are non-bottom by definition. But if x G K and x' ~ x for x' outside K, 
it doesn't follow that p(x') ^ _L (consider e.g. K = for a = t — > o and p(a) = a(-L)). 

The following closure properties of entire sets are easily verified: 

(1) UK <ZD and K' C £>' are entire, so is K x K' <Z D x D' 

(2) If is a sequence of entire subsets of D, then FL is an entire subset of D w . 

Definition 4.15. The image of an entire set by a total function doesn't need to be entire, 
but it consists of total elements, and hence its closure under total equivalence is entire. We 
refer to this as its entire image. (Thus, entire images are defined for total functions and 
entire sets only.) □ 

Proposition 4.16. Exhaustible and searchable sets are closed under the formation of com- 
putable entire images. 

Proof. For given /: D —* D' and K C D exhaustible, consider the quantification functional 

W f{K) (q)=WxeK.q(f(x)). 

defined in the proof of Proposition 14.31 If / is total and K is entire with entire image L, 
then we can take Vl = Vmn- To verify this, let q be defined on L. Then q is defined on 
f(K) C L, and hence if q(l) = 1 for all I G L, then Vi(g) = 1. If, on the other hand, q(l) = 
for some I G L, then I ~ f{x) for some x G K. But then q{f{x)) = 0, and so Vr(<?) = 0, 
which concludes the verification. The argument for searchable sets is similar. fj 

Definition 4.17. Let S = {_!_, T} by the Sierpinski domain and F C D = D a be entire. 

(1) F is decidable if there is a total computable map ipp : D — > B such that, for all total 
x G D, iPf(x) = 1 iff x G F. 

(2) F is semi- decidable if there is a computable map xf ■ F> — > 5 such that, for all total 
x € D, iPf(x) = T iff x G F. 

(3) -F is co- semi- decidable if its complement in T = T a semi-decidable. □ 

Notice that the functions ipF is not uniquely determined by F, because its behaviour 
is specified on a subset of D, but that xf is uniquely determined by F. Notice also F is 
decidable if and only if it is decidable on T in the sense of Definition 14.11 with K = T. 

5. Compactness of exhaustible sets 

A notion analogous to exhaustibility, with the Sierpinski domain S playing the role of 
the boolean domain £>, is considered in [18]. A crucial fact, formulated here as Lemma 12.21 
is that the (now unique) quantification functional : (D — > S) — > S is continuous iff 
the set K is compact in the Scott topology of D. Hence, because computable functionals 
are continuous, Sierpinski-exhaustible sets are compact, and so Sierpinski exhaustibility is 
seen as articulating an algorithmic version of the topological notion of compactness. The 
computational idea is that, given any semi-decidable property of D, one can semi- decide 
whether it holds for all elements of K. Closure properties analogous to the above are 
established for Sierpinski exhaustibility in |18j . 
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The present investigation can be seen as a natural follow-up of that work that arises 
by asking what changes if one moves from semi-decision problems to decision problems. 
One significant change is that continuity of a quantification functional \/k '■ {D — > B) — > B 
doesn't entail the compactness of K in the Scott topology any longer: 

Examples 5.1. 

(1) There are exhaustible sets that fail to be compact in the Scott topology. 

By [301 [36] , any second-countable To space, e.g. the real line R, can be embedded 
into the domain D = B^ under the Scott topology. But R is a connected space, 
which is equivalent to saying that every continuous boolean-valued map defined on 
it is constant. Hence a predicate p £ (D — > B) is defined on R iff it is constant on R. 
Therefore R is trivially exhaustible: Vr(p) = p(0). But it is not compact. 

Notice also that any space embedded into the total elements of B u must be totally 
disconnected, and hence any embedding of R into B u must assign non-total elements 
of B u to some real numbers. One may suspect that if such embeddings are ruled 
out, this problem would disappear. But this is not the the next example 

shows. 

(2) There are exhaustible sets of total elements that fail to be Scott compact. 

In fact, there is a trivial and pervasive counter-example. Let / € ((TV — > TV) — > TV) 
be total. Then the total equivalence class K of /, as is well known and easy to 
verify, doesn't have minimal elements, and hence cannot be compact in the Scott 
topology. But it is exhaustible with ^k{p) = p(f)- D 

One may feel somewhat cheated by the second counter-example, because although the 
set K is not Scott compact, it is generated by the singleton {/}, which is Scott compact, 
and because we took to be V{j} (cf. the proof of Proposition 14. 16)) . Lemma I531 f3j) below 
shows that any counter-example is generated by a Scott compact set in a similar fashion. 
In any case, although exhaustible sets do fail to be compact in the Scott topology, if they 
consist of total elements then they are compact in the Kleene-Kreisel topology. In order to 
formulate and prove this, we need some definitions. We now rely on Section [2.31 

Definition 5.2. Let a be a type, D = D a , T = T a , C = C a and p = p a : T a — > C a . 

(1) By the shadow of a set K CT we mean its p-image in C. Similarly, by the shadow 
of an element x G T we mean its p-image p{x) in C. 

(2) A set K C T is called Kleene-Kreisel compact if its shadow is compact. □ 

Recall that the Cantor space is the set 2^ of maximal elements of B u . 

Remark 5.3. Sometimes, for example for the implementation of the product functional 
defined in Section 0] in the language PCF, which lacks countable powers, one works with 
the Cantor space within the function space B M . The Cantor space is homeomorphic to 
the subspace of total strict functions a € B , where a is strict if a(_L) = _L. It is also 
homeomorphic to the quotient of the set of all total elements of B^ . But notice that the 
set of maximal elements of B^ is not homeomorphic to the Cantor space. This is because 
the two non-strict elements Ai.O and Ai.l are finite (or order compact), and hence isolated in 
the relative Scott topology (meaning that the two corresponding singletons are open), and 
hence the maximal elements have a topology strictly finer than that of the Cantor space, as 
there are no isolated points in the Cantor space. As is well known in topology, no compact 
Hausdorff topology can have another compact Hausdorff topology as a strict refinement. □ 
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Every (computationally) exhaustible set is topologically exhaustible in the sense of the 
following definition, because computable maps are continuous. 

Definition 5.4. We say that a set K C D is topologically exhaustible if there is a continuous 
map Vx G {{D — > £?) — > /3) satisfying the conditions of Definition 13.21 □ 

The following is our main tool in the constructions and proofs of correctness and termination 
of algorithms developed in Sections [6H3 Its proof relies on Sections 12.41 and 12.51 

Lemma 5.5. 

(1) Any topologically exhaustible set of total elements is Kleene-Kreisel compact. 

(2) Any non-empty, Kleene-Kreisel compact entire set is an entire continuous image of 
the Cantor space and hence is topologically exhaustible. 

(3) Any Kleene-Kreisel compact entire set has a Scott compact subset with the same 
shadow. 

Proof. (H|): Let K C T be exhaustible. By Lemma 12.61 and the fact that clopen sets are 
closed under finite unions, to establish compactness of p(K), it is enough to consider a 
directed clopen cover U. By Lemma l2~5l for every U G U there is a total pu G (D — > B) 
with 

(t) p-\U)Qpv\l) andp- 1 (C\Lr) Cp-^O). 
Define predicates qu,r G (D — > B) by 

qu Hl)=Pv\l), r-\l)=\Jpu\l), g~ 1 (O)=r- 1 (O)=0. 

Then qjj C pu, the set | U G is directed, and r = Uc/gW^- Because p(K) C (JW, 
we have that if C r _1 (l) and hence Vfi-(r) = 1. So, by continuity of V^, there isU €U with 
Vk(qu) = 1) and hence with ^k{pu) = 1 by monotonicity. Let x £ K. Then pu(x) = 1 
by specification of Vr- and the fact that pu is total and hence defined on K. But then 
p{x) G ?7, for otherwise (f) would entail pu{x) = 0. This shows that p(if) C f/, and so 
p(-fiT) is compact. 

([2]): By e.g. [21], any compact subset of C is countably based (even though C is not). 
But any non-empty compact Hausdorff countably based space is a continuous image of the 
Cantor space. Hence there is a continuous map 2 W — > C with image /9(if) for any entire set 
K Q D. Then the entire image of the Cantor space under any representative B u — ► D is iT. 

([3]): This follows from the argument given in ([2]), because the Cantor space is Scott 
compact. □ 

Remark 5.6. In particular, this gives a topological view of the computational fact stated 
in the introduction that exhaustible sets of natural numbers must be finite: all compact 
sets are finite in a discrete space. □ 

Kleene-Kreisel compactness can be expressed as a finite-subcover condition for the Scott 
topology as follows: An entire set K C D is Kleene-Kreisel compact if and only if every 
cover of K by Scott open sets that are closed under total equivalence has a finite subcover. 
This is a straightforward consequence of the fact that the Kleene-Kreisel topology is the 
quotient by total equivalence of the relative Scott topology on the total elements. 

We also remark that there is a natural topology on D, coarser than the Scott topology, 
in which all exhaustible sets are compact. Part of the argument of Lemma l5.5HfT1) shows 
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that any exhaustible set K is compact in the coarsest topology on D such that all predicates 
p G [D G B) defined on K are continuous. This is generated by directed unions of basic open 
sets of the form p~ l {l) with p as above, because such sets are closed under finite unions 
and intersections. This construction is analogous to the zero-dimensional reflection of a 
topology, and happens to coincide with it in the case considered in Lemma l531 [Tj) . modulo 
quotienting, and can also be compared with the weak topology in functional analysis. 



We already know that every searchable set is exhaustible (Lemma l3.4p . This implication 
is uniform, in the sense that there is a computable functional 



that transforms selection functionals into quantification functionals, namely e i— > \p.p{e{p)). 
We now establish the converse for non-empty entire sets, and some additional results. The 
fact that exhaustible entire sets are Kleene-Kreisel compact, established in the previous 
section, plays a fundamental role in the construction of the algorithms 

Definition 6.1. We say that a set S Q D = D a is a retract up to total equivalence if there 
is a function r G {D — > D) such that 



In this case, r is total, all elements of S are total, and r{r{x)) ~ r(x) for all total x. 
Notice that r is a retract up to total equivalence iff it is a total function and its Kleene- 
Kreisel shadow p(r) : C — > C is a retract in the usual topological sense, where C = C a . 

Definition 6.2. We say that two entire sets K C D = D a and LCE = D T are homeo- 
morphic up to total equivalence if there are total functions / G (D — > E) and g G (E — > D) 
such that g(f(x)) ~ x and f(g(y)) ~ y for all x G K and y G L. □ 

This is equivalent to saying that the shadow functions p(f) and p{g) restrict to a (true) 
homeomorphism between the shadows of K and L. In this case, L is the entire /-image 
of K, and K is the entire g- image of L. 

Theorem 6.3. If K C D = D a is a non-empty, exhaustible entire set then, uniformly in 
any quantification functional for K: 

(1) K is searchable. 

(2) K is a computable entire image of the Cantor space. 

(3) K is computably homeomorphic to some entire exhaustible subset of the Baire do- 
main Af^ , up to total equivalence. 

(4) K is a computable retract up to total equivalence. 

(5) K is co-semi-decidable. 

In particular, after the theorem is proved, one can w.l.o.g. work with total predicates 
rather than predicates defined on K, as for any predicate p G (D a — > B) defined on K 
one can uniformly find a total predicate that agrees with p on K, by composition with the 
retraction. 



6. Searchability of exhaustible sets 



((D ^B)^D)^ ((D ^B)^B) 



(1) r(x) G S for all total x G D 




□ 
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Proof. We proceed by cases, of increasing generality, on the type of K. The case K C J\f 
is trivial and is implicitly used in the case K C N u , which in turn is used in the next case 
K C (D — > TV). The general case K C D is reduced to this last case via retracts using 
Lemma 12.11 

(i) Case K C A/": We can define 

/xn.3m G if.n = m A if 3n G K.p(n), 

[in.Bm G if.n = m otherwise. 



£A-(P) 



This construction defines uniformly in 3^-. We could now easily show that K satisfies 
the other conditions of the theorem, but this won't be required for our proof, as this will 
follow in later cases. 

For future use, notice that if K C J\f is entire and exhaustible, then the supremum of 
the finite set K (which is zero if K is empty and the largest element of K otherwise) can 
be computed uniformly in any quantification functional for K as 

sup if = /im.Vn G K.n < m. 

Hence, the finite enumeration e n of the elements of if, in ascending order, for < n < 
cardinality (if), is uniformly computable as 

e n = (iy.3m G K.Mi < n.m ^ A m = y. 

We stop when we find n such that e n = sup if, and we include e n iff 3m G K.m = sup if. 

(ii) Case K C J\f w . We first argue that we can find some a G K , uniformly in 3k, by 
the following algorithm defined by course-of- values induction on n: 

a n = fj,k.3P G K.a = n (3 A j3 n = k. 

Recall that we defined 

a = n (3 <^=> Vi < n.fti = a.i 
in the paragraph preceding Theorem 14.91 By construction, for every n there is f3 G K with 
a = n 0, and in particular a is total. Because the shadow of K is compact, it is closed, and 
because K is entire, a G K , as required. Then we can define, using Proposition 14.21 and the 
above algorithm to construct a in both cases, 

J some q G K D p _1 (l) if 3a G K.p(a), 
I some a G K otherwise. 

Again, this construction defines ek uniformly in 3k- 

We now show that if is a computable retract up to total equivalence, uniformly in any 
quantification functional for K. Define 

r = r K : -> 

by course-of- values induction on n: 

a n if 3(3 G K.{3 = n r(a) A /3 n = a n , 

[im.3(3 G K.(3 = n r(a) l\(3 n = m otherwise. 

Because the shadow of K is closed, the finite prefixes of its members form a tree whose 
infinite paths correspond to the elements of K. The above algorithm follows the infinite 
path a through the tree, either for ever (always following the first case) or until the path 



r(a)(n) 
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exits the tree (reaching the second case). If and when a exits the tree, we replace the 
remainder of a by the left-most infinite branch of the subtree at which a exits the tree. 
Then r clearly satisfies the required conditions. 

A semi-decision procedure for the complement of K is given by 

a G" A r(a) ^ a, 

using the fact that apartness of total elements of Af u is semi-decidable. (This is a compu- 
tational version of the topological fact that retracts of Hausdorff spaces are closed.) 

We now show that A is a computable entire image of the Cantor space. For any i, the 
set Ki = {aj | a G A} is exhaustible by Proposition 14.31 as evaluation at i is computable. 
It is enough to show that fT^O, 1, . . . , sup Aj} C J\f w is an entire image of the Cantor space 
by a computable map t : W — > Af^ , because then rot has A as its entire image since A is 
contained in that product. But this is straightforward: at each stage j of the computation 
of t(a), look at the next [~log 2 (sup Aj)] digits of the input a, compute the natural number 
f(j) represented by this finite sequence, and let t(a)(j) = min(sup Kj, f(j))- 

(Hi) Case A C (D — > Af) where D = D a for an arbitrary type a: In order to reduce this 
to case (ii), we invoke the Kleene-Kreisel density theorem, to get a computable sequence 
d G such that the shadow sequence p(d n ) is dense in C = C a . Define 

P: (D -> AO -» 

P(f) = \n.f(d n ). 

We will define a total function E = Ek in the other direction, 

E: AT W ^(D^M) 

such that 

R = E o P : (D -> AO -> (D -> A") 
exhibits AT as a retract of (D — > A/") up to total equivalence. Thus, for / S K, one can 
recover the behaviour of / at total elements from its behaviour on the dense sequence d. 
Because this implies that K is the entire image of P(K), and because P(K) is searchable 
by case (ii), it will follow that K is searchable and an entire image of the Cantor space, 
because E preserves total equivalence on P(K). 
For a G M u and n G N, define 

K = {/ € (D -> AO | Vi < n./K) = a,}, A° = A n F n °. 

Here we regard a as potentially coding the action of some / on the set of elements d{. The 
set F" is decidable on K uniformly in a and n, and hence is uniformly exhaustible by 
Proposition 14.21 

Lemma 6.4. If K C A") is a Kleene-Kreisel compact entire set, then for all total 

a G AA W and aZZ totaZ iGO f/iere is n suc/i i/iai /(x) = /'(x) /or all f, f G A^. 

Proof. For any g G C a ^, L the set B g = {f £ C a ^ L \ f(x) = g(x)} is clopen, where we write 
x = p(x). By density of d n , the set f] n K" has at most one element, where denotes the 
shadow of A". Hence if g G f] n then f] n = {g} C Because C a ^ L is Hausdorff 
and because each K% is compact and B g is open, there is n such that already CB 9 . So 
for all / G one has f(x) = g(x), and hence for all /, /' G one has f(x) = f'(x). □ 
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By Proposition 14,161 the entire P-image L C J\[ u of K is exhaustible. Let r = be 
defined as in case (ii), and define E: J\[ w — > (P — > TV) by 

E(a)(x)=/ J ,y3feK$'*\f(x)=y, 

where n is the least number such that V/,/' G K^ a \f(x) = f'{x). By exhaustibility 
of this can be found uniformly in a, and hence E is computable uniformly in K. 

Proof of correctness of E. 

(a) E is total and maps L into K. Let a G /V w be total. Then r(a) G L, by construction 

of r, and hence there is g G K with r(a) ~ P(d), an d so with g G Kn for any n. Let 
iGDbe total and n be the least number such that f(x) = f'(x) for all /, /' G K^ a \ Then 
f(x) = g(x) for all / G K^ a \ and hence E(a){x) = g(x). Therefore E(a) ~ g G K, and 
hence P(a) G K as iT is entire, and in particular E is total. By construction E ~ E o r, 
and hence, because r exhibits L as a retract up to total equivalence and K is entire, the 
P-image of L is K. 

(b) Iff£(D^M) is total then R{f) = E{P{f)) G K. Because P(f) G L. 

(c) If f G K then R(f) ~ /. Continuing from the proof of (a), for a = P(f) we have 
r(a) ~ a by construction of r, and hence for any g G K such that -P(g) = r(a) we have 
g(cij) = P(g)(i) = r(a)(i) = 014 = P(f)(i) = f(di) and so g ~ / by density, which shows 
that R(f) = E(P(f)) ~ /, as required. □ 

A semi-decision procedure for the complement of K is given as in case (ii), 

f^K^ R(f) ± f, 

because f ^ f 3n G N.f(d n ) 7^ f'(d n ), for total functions /' and / since K is entire 

and d is dense. 

Because E and P are total, they induce computable Kleene-Kreisel functionals E = 
p(E) : N N -» N c and P = p(P) : N c -» N N where C = C^. If K C N c is the shadow of K, 
then the restriction of P to .K" followed by the co-restriction to its image is a homeomorphism 
K — > P(K): abstractly because any continuous bijection of compact Hausdorff spaces is 
a homeomorphism, and concretely because the bi-restriction of E is a continuous inverse. 
Hence any exhaustible subset of (D — > TV) is computably homeomorphic to the shadow of 
some exhaustible subset of the Baire domain /V w , up to total equivalence. 

(iv) General case. We derive this from the case (Hi). By Lemma 12. 11 for any D = Do- 
there are D' = D T ^ L and computable P : D' — > D and E: D — > D' such R = E o P is 
a retraction up to total equivalence and T a is the entire image of P. Let -fC C D be a 
non-empty, exhaustible entire set, and let K' be the entire P-image of K. Then K is the 
entire image of P(K'), and, because K is entire, a predicate p' G (P' — > B) defined on K' 
holds for all x' G K' if and only if p' o E holds for all x G K. Hence K' is exhaustible with 
Vk'(p') = ^k(p' E). By case (Hi) above, K' is searchable. Therefore K is searchable by 
Proposition 14.31 Similarly, the other properties we need to establish are closed under the 
formation of retracts and hence are inherited from case (Hi). 

This concludes the proof of Theorem 16.31 □ 
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7. Ascoli-Arzela type characterizations of exhaustible sets 

We reformulate a theorem of Gale's [22] that characterizes compact subsets of function 
spaces (Theorem IT. 1 1) . This suggests a characterization of exhaustible entire sets (Theo- 
rem [73]), whose topological version is developed first (Theorem \7A\i . The main idea is to 
replace a condition in Gale's theorem by a continuity condition (Section 17. ip . and then 
further replace it by a computability condition (Section 17. 2p . This method of transform- 
ing topological theorems into computational theorems is the main thrust of the paper [18] . 
which develops many instances of computational manifestations of topological theorems. 

7.1. Topological version. The Heine-Borel theorem characterizes the compact subsets 
of Euclidean space M. n as those that are closed and bounded. The Arzela-Ascoli theorem 
generalizes this to subsets of , where X is a compact metric space and M. x is the set of 
continuous functions endowed with the metric defined by 

d(f,g) = max{<Z(/(x),#(x)) j x E X}. 

A set K C R x is compact if and only if it is closed, bounded and equi-continuous. Equi- 
continuity of K means that the functions / E K are simultaneously continuous, in the 
sense that for every x E X and every e > 0, there is 5 > such that d(x, x') < 5 =>■ 
d(f(x), f(x')) for all x' E X and all / E K. The Heine-Borel theorem is the particular case 
in which X is the discrete space {1, . . . , n}, for equi-continuity holds automatically for any 
subset of M. x in this case. The above metric on W x induces the compact-open topology. 
More general Arzela-Ascoli type theorems characterize compact subsets of spaces Y x of 
continuous functions under the compact-open topology, for a variety of spaces X and Y, 
with a number of generalizations or versions of the notion of equi-continuity, notably even 
continuity in the sense of Kelley [28] . 

Among a multitude of generalizations of the Arzela-Ascoli theorem, that of Gale [22^ 
Theorem 1] proves to be relevant concerning exhaustibility of entire sets: 

If X and Y are Hausdorff k-spaces with Y regular, a set K C Y x is compact 
if and only if 

(1) K is closed, 

(2) the set K{x) = {f{x) j / E K} is compact for every x E X , 

(3) the set Clf^KnF ^ s °P en f or every closed set F C Y x and for 
every open set V QY . 

Gale didn't assume Y to be a /c-space and formulated this for the compact-open topol- 
ogy, but his theorem holds for the exponential topology if we require Y to be a fc-space. 
Regarding compactness, we have already mentioned that a Hausdorff space has the same 
compact sets as its fe-coreflection, and that the exponential topology is the ^-reflection of 
the compact-open topology. Although there are more closed sets in the exponential topol- 
ogy, Gale's argument works with closedness of K in the exponential topology. This follows 
from the general considerations of Kelley [28^ Chapter 7] . 

The last condition is a version of equi-continuity. Because X is not assumed to be 
compact, the set K cannot be globally bounded in any sense, but it is pointwise bounded 
in the sense of the second condition. This gives a characterization of compact subsets of 
Kleene-Kreisel spaces of the form N c and in particular of Kleene-Kreisel spaces of pure type, 
because N is regular. However, as discussed in Section 12.51 Matthias Schroder has recently 
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shown that N is not regular, and this justifies the restriction of our characterizations of 
exhaustible entire sets to particular kinds of types in Section 17.21 

Notice that when X = Y = N, this amounts to the well known characterization of 
compact subsets K of the Baire space N w as finitely branching trees. The equi-continuity 
condition, as in the case of the Heine-Borel theorem, is superfluous, because any set is equi- 
continuous in this case as the topology of the exponent is discrete. Condition (1) says that 
the elements of K are the paths of a tree, and (2) says that the tree is finitely branching, 
because the compact subsets of the base space are finite. 

Lemma 12.21 and the remarks preceding it allow one to consider continuity of functions 
involving points of a /c-space X, open sets and closed sets (using the function space S x and 
representing open sets and closed sets by their characteristic functions), and compact sets 
(using the function space S sX and representing compact sets by their universal quantifi- 
cation functionals). We now reformulate Gale's theorem by expressing condition (3) as a 
continuous version of a slight strengthening of condition (2). 

Theorem 7.1. If X andY are Hausdorff k-spaces with Y regular, a set K C Y x is compact 
if and only if 

(1) K is closed, and 

(2) (K n F)(x) is compact, continuously in F and x, for any closed set F C Y x and 
any x G X. 

The dependence of (K n F){x) in the parameters F and x is given by the functional 

$:S YX xX^S sY 
defined by <$>(xf,x) = V(Kr\F)(x)) where we write 

XF = Xfc- 

Proof. (=>): The set K is closed because Y x is Hausdorff. The set K n F is compact 
because F is closed. Because the evaluation map is continuous and because (K n F)(x) 
is the continuous image of K n F under evaluation at x, it is compact. To see that $ is 
continuous, let v G S Y . Then v(y) = T for all y G (K n F)(x) v(f(x)) = T for all 

/ £KHF ^=> / G F c or v(f(x)) for all / G K. Hence 

*(w,x) = Aw.V/ G K.w(f)Vv{f{x)), 

where (V) : S x S — > S is defined by a V b = T iff a = T or b = T. Because the functional 
\/k is continuous as K is compact, and because the category of £;-spaces is cartesian closed 
and the above is a A-definition from continuous maps, $ is continuous. 

(<=): It suffices to show that Gale's conditions (l)-(3) hold. Condition (1) is the same 
as ours, and Gale (2) follows from our condition (2) with F = Y x . To prove Gale (3), let 
F C Y x be closed and V C Y be open. Then the set 

U = {xeX\<S>(xF,x)(xv) = T} 

is open because $ is continuous, and 

x g U V( K nF)(x)(v) = T <=> Xv(y) = T for all y G (K D F)(ar) 

Xv(/(«)) = T for all / G K n F /(x) G V for all / G K n F 

^ ^fl/eifnFr 1 ^). 

which shows that the set Hfe-KTi-F ^ s ^ ne same as ^ an d hence is open. □ 
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Definition 7.2. We say topologically decidable etc. taking the continuous versions of Defi- 
nitions ED and HT3 □ 

We now formulate and prove an analogue of this theorem, which replaces (i) the Sier- 
pinski space S by the boolean domain B, (ii) Hausdorff /c-spaces by Scott domains, (iii) com- 
pact subsets by topologically exhaustible entire subsets, (iv) closed subsets by topologically 
decidable sets (cf. Definitions 13.21 and 15, 4p . We again apply Gale's theorem, exploiting 
Hyland's characterization of the Kleene-Kreisel spaces as A:-spaces. The proof follows the 
same pattern as that of Theorem 17. 1\ but there are a number of additional steps. Firstly, 
using Gale's theorem, we get continuous maps defined on Kleene-Kreisel spaces. These are 
extended to continuous maps on domains using the Kleene-Kreisel density theorem and 
Scott's injectivity theorem, as in Lemma 12.51 (In Theorem I7.5| such an extension will be 
instead defined by an algorithm, but still relying on the density theorem.) Secondly, the 
set F in condition (2) is closed in Theorem 17.11 but is neither open nor closed in Theo- 
rem [731 although it has clopen shadow, because the Sierpinski space has been replaced by 
the boolean domain. To overcome this difficulty, we rely on the following version of Gale's 
theorem: 

Remark 7.3. An inspection of the proof of Gale's theorem shows that it also holds if, in 
condition (3), the set F ranges over subbasic closed sets in the compact-open topology: 
3'. the set C\feKnN(Q B) f~ l (V) ls open for every compact set QCI, every closed set 
B C Y, and every open set V C Y. 

In one direction this is clear: if condition (3) holds for all closed F, then it holds for F = 
N(Q,B). For the other direction, notice that condition (3) is used only in the "Lemma" 
[22"1 page 305] for F of this form (the sets W x in the second last line of that page, and the 
set T of page 306). □ 

Let D = D a and C = C a for an arbitrary type a, and recall the concepts and notation 
introduced in Definitions 14.171 and 15.41 

Theorem 7.4. An entire set K C [D — > Af) is topologically exhaustible if and only if the 
following two conditions hold: 

1. K is topologically co- semi- decidable. 

2. The set (KnF)(x) is topologically exhaustible for any F that is topologically decidable 
on K , and any x £ D total, continuously in F and x. 

Here the dependence of {K n F)(x) in F and x is to be given by a functional 
r: ({D -> AO -» B) x D -» {[Af -> B) -> B) 
such that T(tpF,x) = VricnFVx)- 

Proof. (=>■): (1): By Lemma |5.5| the shadow K = p(K) C N c of K is compact and hence 
closed. Hence the map N c — > B that sends / E K to _L and / ^ K to 1 is continuous. By 
composition with the quotient map p: T — > N c , where T = T a ^ L , we get a map T — > B. 
Because T is dense in (D — > Af) and B is densely injective, the domain D a ^ i under the 
Scott topology is injective over dense embeddings, which means that this map extends to 
a continuous map (D — > Af) — > B. By construction, this exhibits if as a topologically 
co-semi-decidable subset of (D — > Af). 
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(2): Define T(ipF,x) = Ap.V/ € K.ipF(f) p(f(x)). The result then follows from 

the fact that the category of Scott domains under the Scott topology is cartesian closed, 
and hence functions that are A-definable from continuous maps are themselves continuous. 

(<=): We apply Gale's theorem to show that the shadow K = p(K) is compact. Then 
it is topologically exhaustible by Lemma 15.51 

Gale (1): If K is topologically co-semi-decidable, then, by definition, we have a contin- 
uous function (D — > AT) — > B that maps / G K to _L and / ^ K to 1. Hence K is closed 
in T because it is the inverse image of the closed set {_!_} restricted to T. Because K is 
entire, it is closed under total equivalence by definition, and hence, because p: T —> N c is 
a quotient map, K is closed. 

Gale (2): The assumption gives that for any x € D total, K(x) is exhaustible, consid- 
ering F = {D — > J\f). Because K is entire and x is total, K{x) C N. Hence by Lemma |5.5| 
K(x) is compact in N C J\f. 

Gale (3): Let F C N c be a subbasic open set of the form N{Q,V) with Q C C 
compact and V C N (necessarily) clopen. Then the set Q = p^ 1 (Q) is entire and Kleene- 
Kreisel compact, and hence, by Lemma 15.51 it is topologically exhaustible. Also, V is 
a topologically decidable subset of M. So the predicate p: (D — > M) — > £3 defined by 
= Vx G Q-Xv(/(a?)) is continuous and defined on K, and p = ipp for F = T flp _1 (l). 
Now define u : Z) — » B by 

u(x) = r(^,a;)(xv). 

Then n is continuous and 

u(x) = V(KnF)(x){xv) = Vf e Kn F.xv(f(x)). 

Hence the set U = u^il) = {x G T \ V/ G K n F.xvC/C^)) = 1} is °P en - Therefore its 
shadow Pl/e/cnF / _ (^) i s open, because it is closed under total equivalence and because 
p is a quotient map. □ 



7.2. Computational version. At this stage of our investigation, such a characterization 
is available only for certain types, which include pure types, and for entire sets (for the 
reasons explained in Section [7.ip . Let D = D a and C = C a for an arbitrary type a. We 
establish the computational version of Theorem 17.41 

Theorem 7.5. An entire set K C (D — > AT) is exhaustible if and only if the following two 
conditions hold: 

1. K is co-semi-decidable. 

2. The set (K n F)(x) is exhaustible for any F decidable on K , and any x 6 D total, 
uniformly in F and x. 

Moreover, the equivalence is uniform. 

A few remarks are in order before embarking into the proof. The claim holds, with 
the same proof, if conditions (1) and (2) are replaced by any of the following conditions, 
respectively: 

1'. K is topologically co-semi-decidable. 

1". K has closed shadow. 

V" . The shadow of K is closed in the topology of pointwise convergence. 
1"" . K has compact shadow. 
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2'. The set {K n F°)(x) is exhaustible, uniformly in n G A/", a G and x G Z? total. 
Recall (proof of Theorem I6.3P that we defined 

F£ = {/ G (D AO I Vi < n./K) = oj. 

In the formulation of the theorem, the fact that conditions (1) and (2) uniformly imply 
the exhaustibility of K is in principle given by a computable functional of type 



((D -> AO — 5) x (((£> -tJV)-»B)x D — > ((A" — > B) — > B)) (((£> -» M) -+ B) -» B) . 

condition 1 condition 2 conclusion 

However, the computational information given by condition (1) is not used in the con- 
struction of the conclusion (although the topological information is used in its correctness 
proof). Moreover, the information given by condition (2) is not fully used in the construc- 
tion. Replacing it by (2') we get 

a n x VxnF%(x) 

{AT x^x '"d n ) -» \(M ~ B) ~ B)) -> (((D -> AO -> B) -> B) . 

condition 2' conclusion 

Additionally the pair a, n is really coding a finite sequence, and, as we have seen, exhaustible 
sets of natural numbers are uniformly equivalent to finite enumerations of natural numbers. 
Hence the above can be written as 

a,n x VfcnfJ ( x ) 

((A^x^zT)^ A?*" )^{((D^M)^B)^B). 

V V 

condition 2' conclusion 

Therefore the above characterization reduces the type level of Vk by two. 

The last step of the proof of this theorem mimics topological proofs of Arzela-Ascoli 
type theorems (which we haven't included): to show that K C Y x is compact under as- 
sumptions such as those of Gale's theorem (Section l7.ip . one first concludes that n^ex F.{x) 
is compact by the Tychonoff theorem, then shows that the relative topology of K is the 
topology of pointwise convergence, and that it is pointwise closed, and hence concludes that 
it is homeomorphicaHy embedded into the product as a closed subset, and therefore that 
it must be compact. In the proof below, we have replaced the Tychonoff theorem by its 
countable computational version given by Theorem 14.61 using a dense sequence of the ex- 
ponent. The first steps of the proof are needed in order to make this replacement possible, 
and they are modifications of the constructions developed in Section [6J 



Proof. (=>) (1): Theorem[ 

(2): Define V^f(p) = V/ G K^ F {f) =► p(f(x)). 

(<=): By Theorem \7A\ the set K is topologically exhaustible, and hence is Kleene- 
Kreisel compact by Lemma [53] This compactness conclusion is our only use of Theorem 17.41 
in this proof. We apply this to establish the correctness of the algorithms defined below. 

Define P: (D — > A/") — > Af u by P(f)(i) = f(di), as in the proof of Theorem 16.31 where 
d G D w is a computable dense sequence, and let L = P(K). Because F" is decidable on K, 
the set K° = KnF® is exhaustible by Proposition 14.21 and K"(x) is exhaustible uniformly 
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r(a)(n) 



r(a)(n) 



r(a)(n) 



in a, n and x G K by Proposition 14 . 31 applied to evaluation at x. Now modify the definition 
of r : Af w — > A/" w given in Theorem 16.31 as follows: 

(a« if 3y G K r ^ a \d n ).a n = y, 

\[iy.3y' G Kn \dn).y = y' otherwise. 
Then r is computable, and satisfies 

a n if 3/ G K.f{d n ) = a n A Vi < n.f(di) = r(a)(i), 

Hy3f G K.f(d n ) = y A Vi < n.f(di) = r(a){i) otherwise. 

Hence it also satisfies 

Q« if 3/3 G L.p n = a n A Pi = n r(a), 

Hy.3(3 G £./3 n = y A (3 = n r(a) otherwise. 

This shows that r = for rx as defined in Theorem 16.31 But notice that, although the 
second and third equations hold, the algorithm is not the same as in Theorem 16.31 In fact, 
the second and third equations don't establish computability of r, because exhaustibility of 
K and L are not known at this stage of the proof. In any case, the last equation shows that 
r exhibits L as a retract up to total equivalence, using the fact that L, being the continuous 
P- image of K, is topologically exhaustible and hence is Kleene-Kreisel compact, as in 
Theorem 16.31 

Similarly, modify the definition of E : — > (D — > jV) in Theorem 16.31 as follows: 

E(a)(x) = w.3y' e K n ^(x).y = y', 

where n is the least number such that Vy, y' G Kn \x).y = y'. Because this condition is 
equivalent to V/,/' G Kn^ a \f{x) = f'(x), such a number exists by Lemma [6.41 and the 

compactness of the shadow of K. By uniform exhaustibility of the set K^ a \x), this can be 
found uniformly in a and x, and hence E is computable. Moreover, although the definition 
of E is not the same, as before, we again have E = El for El defined as in Theorem 16.31 

Finally, because K = KPiF for F = (D — > J\f), the set K(x) is exhaustible uniformly in 
x G D total, and hence the set M = JT i K[di) C A/^ is searchable uniformly in x h- » V^)- 
In fact, each K{di) is searchable uniformly in i, by Theorem 16.31 and hence M is searchable 
by Theorem 14.61 Now L C M and hence the entire r-image of M is L, and hence L is 
searchable by Proposition 14.161 In turn K is the entire .E-image of L and hence is also 
searchable. Therefore it is exhaustible. □ 

Notice that the proof actually concludes that K is searchable, and hence we could 
have formulated the theorem as: An entire set K C (D — > jV) is searchable iff K is co- 
semi-decidable and the set (K n F)(x) is exhaustible for any F decidable on X, and any 
i£D total, uniformly in F and x. But this strengthening of the theorem follows from the 
given formulation and the results of Sectional However, we could have included the above 
theorem, with the stronger formulation, before Section [6] and then derived the results of 
that section as a corollaries. But we feel that the developments of both sections become 
more mathematically transparent with the current organization of the technical material. 
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8. Technical remarks, further work, applications and directions 

We now discuss some technical aspects of the above development, announce some results 
that we intend to report elsewhere, and discuss potential applications and directions for 
future work in this field. 

8.1. Analysis of the selection functional given by the product functional. Using 
course of values induction, one easily sees that a functional 

n: {{D ^B)^ D) w -> ((D w ^B)^ D w ) 

satisfies the equation of Definition 14.51 if and only if it satisfies the equation 

11(g) (p) = x * U(e')(p xo ) where x = e {Xx.p x (Il(e')(p x ))) 

and where p x (a) = p{x * a) and e\ = £i+i. Now define a selection function 

e 2 : (B - B) -► B 

for 2 C B by 

£ 2(p) = p(l) = if p(l) then 1 else 

and a selection function 

<5: [JT ^B)^B W 

for the Cantor space 2 W C B u by 

5 = n(A*.e 2 ). 

Then 5 satisfies the equation 

5(p) = x * S(Px ) where x = Pi(S(pi)). 

An interesting aspect of this selection function for the Cantor space is that it doesn't perform 
case analysis on the value of p, and so, in some sense, it doesn't work by trial and error. 

In order to understand this, first notice that the above recursive definition of 5 makes 
sense if the domain of booleans is replaced by any domain T with an element 1 6 T: 

5: (T w -» T) -» T w . 

We consider the case in which T = T w is the domain of possibly non-well-founded u- 
branching trees with leaves labelled by 1. We define this as the canonical solution of the 
domain equation 

T =S {1} + T W , 

where the sum is lifted. Thus, a tree is either _L, or else a leaf 1, or else an unlabelled root 
followed by a forest of countably many trees. Denote the canonical isomorphism by 

{1} + T W ^3t. 

Then P: T w — > T and the forest S(P) 6 T w gives a general formula for solving p{a) = 1 
with a ranging over 2 U . In fact, for any given p € (B^ — > B), define an evaluation function 
eval = evalp : T — ► B by 

eval(l) = 1, 
eval(i- , (a)) = p(Ai. eval(aj)). 
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Equivalently, eval is the unique homomorphism from the initial algebra [1, P] : {1}+T W — * T 
to the algebra [l,p] ■ {1} + B u — > B. Hence the solution a of the equation p(a) = 1 is given 
by evaluating the general solution 5(P) at p: 

Oi = evalp (<5 (P) (i)). 

We illustrate this with finite forests. Any p G (BP — » /3) defined on 2^ is uniformly 
continuous, and hence of the form p(a) = q(ao, . . . , a n _i) for some n and for q: B n — > <B 
defined by this equation. Now consider the domain T = T n of n-branching trees, 

T ^ {1} + T n , 

and denote the canonical isomorphism by 

{1} + T n T. 

To make sense of the above definition of 5 for this choice of T, define x*(ao, . . . , ct n —2i a n— l) = 
(x,«0) • • • ,&n-2) G T" 1 for x G T and a G T n . We tabulate some forests, which grow dou- 
bly exponentially, but only exponentially if auxiliary variables are used to denote common 
subtrees (corresponding to the variable xq in the recursive definition of 5): 

n 5(Q) 

1 Q(l) 

2 (Q(l,Q(l,i)),Q(Q(l,Q(l,l)),l)) 

3 (xo,x 1 ,x 2 ) 

where 

x = Q(l,y,Q(l,y,l)) withy = Q(1,1,Q(1, 1,1)), 
xi = Q(x ,l,Q(x ,l,l)), 
x 2 = Q(x ,x 1 ,l). 

In order to find (xq, x\, x 2 ) € B 3 such that q(xo, x\, x 2 ) = 1 holds, we substitute q for Q 
in the above equations, compute (xo, x±, x 2 ), and check whether q(xo,xi,x 2 ) = 1 holds. If 
it does, then we have found a solution (in fact the largest in the lexicographic order), and 
otherwise we conclude that there is no solution. Thus, the forest 5(Q) gives a closed formula 
for solving the equation q(a) = 1, and telling whether there is a solution, composed only 
from q and the constant 1. To solve q(a) = 0, just replace 1 by in the formula. 

8.2. Solution of equations with exhaustible domain. By definition, a set K C D is 
searchable iff for every predicate p G (D — > B) defined on K one can find xo £ K, uniformly 
in p, such that if the equation p(x) = 1 has a solution x G K, then x = xq is a solution. 
We first observe that this is equivalent to requiring that for every function / G (D — > TV) 
defined on K and any total y G M one can find xq G K, uniformly in / and y, such that if 
the equation f(x) = y has a solution x G K, then x = xq is a solution. For one direction, 
consider the predicate p(x) = (f(x) == y), and, for the other, consider the natural inclusion 
of B into J\f (which is the identity under our notation). Clearly, this generalizes from J\f to 
any domain E = D a with a discrete in the sense of Definition 14.121 But notice that in this 
case the equation has to be written in the form f(x) ~ y. 
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It is natural to ask whether this generalizes to functions / € (D — ► E) with E arbitrary. 
But it is known that, in general, if an equation has more than one solution, it is typically 
not possible to algorithmically find some solution [6]. We announce the following result: 
Let D = D a ^n and E = D T ^ L for types a and r, let K C D be an exhaustible 
entire set, F E (D — > E) be total and go E E be total. 

(1) If the equation F(f) ~ go has a solution f E K , unique up to total 
equivalence, then some fo~fis computable, uniformly in F, go and 
any universal quantification functional for K. 

(2) It is semi-decidable whether F(f) ~ go doesn't have a solution f E K, 
with the same uniformity condition. 

In order to establish this, we prove the following generalization of Lemma 16.41 Let K n C 
D„^ ( be a sequence of entire sets such that K n D K n +l an d that f] n K n is the equivalence 
class of some total /. Then one can find a computable total function /o ~ /> uniformly in 
any sequence of universal quantification functionals for K n . 

This is not very useful in computable analysis via representations, because typically 
uniqueness, when it holds, is only up to equivalence of representations rather than total 
equivalence. But we do have a corresponding result for equations involving real numbers. 
In light of the following, it is natural to ask whether there is a further corresponding result 
for real valued functions of real variables. 

8.3. An exhaustible set of analytic functions. An application of the exhaustibility of 
the Cantor space to the computation of definite integrals and function maxima has been 
given by Simpson [33]. A generalization of this is developed by Scriven [12]. We consider 
computation with real numbers via admissible Baire-space representations [36] and domain 
representations [15]. For any x € I = [—1/2, 1/2] and any sequence a E [—6, fr]^, the Taylor 
series Y^ n a nX n converges to a number in the interval [—2b, 2b}. We announce the following 
example of a searchable, and hence exhaustible, set: 

For any real number b > 0, the set A = At of analytic functions f : I — > R 



has a searchable set of representatives, uniformly in b. 
In our proof of this, we argue that any / E A can be computed uniformly in its Taylor 
coefficients and use the fact that [—b, b\ u has a searchable set of representatives. This can 
be used to deduce that: 

(1) The Taylor coefficients of any / E A can be computed uniformly in /. 

(2) The distance function dA '■ R 1 — > R defined by 




with a E [—6, b] 



n 



d A (g) =mm{d{f,g) \ f E A} 

is computable (cf. Bishop's notion of locatedness |13l I14j ). 
(3) For any / E R 1 , it is semi-decidable, uniformly in /, whether f ^ A. 
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8.4. Peano's theorem. This celebrated theorem asserts that certain differential equations 
have solutions, but without indicating what the solutions might look like. Its proofs are 
typically based on the Arzela-Ascoli theorem, and proceed by applying Euler's algorithm to 
produce a sequence of approximate solutions. In general, however, this sequence is not con- 
vergent, but, by an application of compactness, there is a convergent subsequence, although 
no specific example is exhibited by this argument, which is then easily seen to produce a 
solution of the equation. It is therefore natural to ask whether our tools could be applied to 
compute unique solutions of such differential equations under suitable assumptions. Here 
the goal is not to obtain a usable algorithm, but rather to understand the classical proof 
from a computational perspective in connection with the notion of exhaustibility and its 
interaction with the notion of compactness and with the Arzela-Ascoli theorem. 

8.5. Uncountable products of searchable sets. It is natural to ask whether the count- 
able product theorem 14.61 can be generalized to uncountable index sets. This question is 
pertinent in view of well known constructive versions of the Tychonoff theorem in locale 
theory [27] and formal topology [16] . which don't restrict the cardinality of the index set. 
However, this seems unlikely in the realm of Kleene-Kreisel higher type computability the- 
ory. Consider the case in which the index set is the Cantor space. By the classical Tychonoff 
theorem, the product of 2 w -many copies of 2 is compact. This product could be written 
as 2 2 . But this notation in higher-ype computation is interpreted as a function space, 
and in the category of Kleene-Kreisel spaces one has 2 2 = N, because the base is discrete 
and the exponent is compact (cf. Theorem 14. 13 j) . This phenomenon in fact also takes place 
in the categories of locales |26] and topological spaces [18] . In the Tychonoff theorem for 
locales or spaces, the indices form a set or equivalently a discrete space. But a discrete 
Kleene-Kreisel space is countable (and more generally a discrete QCB space is countable). 

8.6. Totality of the product functional and bar recursion. In Theorem 14.61 we con- 
structed a computable functional n such that H(e)(p) G Ili^ whenever S{ is a selection 
functional for a set K{ and p is defined on JT . Ki . It is natural to ask whether the func- 
tional n is actually total. Paulo Oliva has shown that this is indeed the case (personal 
communication). Moreover, he has observed that if the type of booleans is replaced by the 
type of natural numbers, our recursive definition of n still makes sense and that it also 
gives rise to a total functional, which he calls CBR (course-of- values bar recursion). He 
additionally proved that CBR is primitively recursively inter-definable with the modified 
bar recursion functional MBR defined in [TT]. We are currently investigating together the 
ramifications of these observations. 

8.7. Alternative notions of exhaustibility. If one is interested only in total function- 
als and sets of total elements, it is natural formulate the following alternative notion of 
exhaustibility: A set K C D is entirely exhaustible if it is entire and there is a total com- 
putable functional Vk : (D — *• B) — > B) such that for every total p € (D — » B) one has 
Vk(p) = 1 iff p(x) = 1 for all x G K. Because, as we have seen, non-empty, exhaustible 
entire sets are computable retracts, it follows that any exhaustible entire set is entirely 
exhaustible. The converse fails (but see the next paragraph), because e.g. any dense subset 
of the Cantor space is entirely exhaustible using Berger's algorithm and the fact that any 
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total predicate is uniquely determined, up to total equivalence, by its behaviour on a dense 
of set of total elements. 

Moreover, when one is only interested in total functions and total elements, it is perhaps 
more natural to work with Kleene-Kreisel spaces directly, without the detour via domains, 
e.g. defined as fc-spaces. QCB spaces are a natural and general setting for such considera- 
tions [31 H] . One might say that a subset K of a space X is totally exhaustible if there is a 
computable functional Vr- '■ (X — > 2) — > 2 such that for every p € (X — > 2), we have that 
Vjf (p) = 1 iff p(x) = 1 for all x G K. When e.g. X = N N , total exhaustibility of K C X 
doesn't entail compactness of if, again considering the example of a dense subset of the 
Cantor space. But Matthias Schroeder (personal communication in 2006) proved that if X 
is a QCB space which is the sequential coreflection of a zero-dimensional Hausdorff space, 
then any totally exhaustible closed set K C X is compact. This includes the case in which 
X is a Kleene-Kreisel space. Using this and the above observations, one can show that, as 
far as higher- type computation with total continuous functionals is concerned, the notions 
of exhaustibility and total exhaustibility agree for closed sets. 

8.8. A unified type system for total and partial computation. As we have already 
discussed, Kleene-Kreisel spaces and Ershov-Scott domains live together in the cartesian 
closed category of compactly generated spaces, and in fact in the subcategory of QCB spaces. 
Additionally, the inclusions of A:-spaces and of Ershov-Scott domains into these categories 
preserve the cartesian-closed structure [211 [3]. Hence total and partial higher-type function- 
als coexist in the same cartesian closed category. One can envisage a higher-type system 
that simultaneously incorporates, but explicitly distinguishes, total and partial objects, 
and corresponding PCF-style formal systems. Among the formation rules one can have two 
types for the natural numbers, with and without _!_, and it would make sense to stipulate 
that a — > r is a partial type whenever a is any type and r is a partial type, and that a — > r 
is a total type when both a and r are total types. In its simplest form, such a language 
could include Godel's system T for total types and PCF for partial types. Such a formalism 
would have simplified, and made more transparent, much of the development concerning 
exhaustible sets of total elements, where we could have benefited from functionals that take 
total inputs and produce potentially partial outputs. In particular, all the technical consid- 
erations of total equivalence and shadows could have been avoided in this way, making the 
development more transparent. Such functionals are actually total, but their construction 
uses modes of definition that belong to the realm of partial computation. The system-T 
fragment could be further extended with total computable functionals such as bar recursion 
and some of those developed here, once one has shown they are indeed total. 

8.9. Time complexity of exhaustive search. In the paper [19], we report some sur- 
prisingly fast experimental results, which serve to counteract an impression that might be 
gained from the technical development that the algorithms presented would be essentially 
intractable and of purely theoretical interest. Moreover, that paper formulates run-time 
conjectures that provide examples of questions that one would like to be able to treat rigor- 
ously and that are potentially useful as target problems for work in higher-type complexity 
theory. The conjectures express the run time in terms of the modulus of uniform continuity 
of the input predicate on the exhaustible set, and hence topology seems to play a role in 
higher-type complexity too. 
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It might be possible to apply our search algorithms to practical problems, e.g. in real 
analysis and in program verification. But it is more likely that, in order to obtain feasible 
algorithms, such applications will need to rely on the development of particular algorithms 
for particular kinds of infinite search tasks, perhaps inspired or guided by the general 
algorithms we have developed, but in any case needing new insights and techniques. In fact, 
this is already the case for finite search problems, as is well known. But the fast examples 
reported in |19j do highlight that the task of obtaining particular search algorithms that are 
efficient for particular kinds of infinite search problems of interest is a direction of research 
that deserves attention and is likely to be fruitful, and that a study of feasible infinite search 
problems cries to be carried out. 



8.10. A fast product functional. We have just discussed that one should look for efficient 
search algorithms for specialized problems. But it is still interesting to ask how fast a general 
infinite search algorithm can be. We don't know the answer, but we report an algorithm 
that outperforms all the algorithms applied for the experimental results of [19], and whose 
theoretical run-time behaviour remains to be investigated. 

We regard an infinite sequence t as an infinite binarily branching tree with the elements 
of the sequence organized in a breadth-first manner: the root is to, and the left and right 
branches of the node t n are i2n+i and i2n+2- With this in mind, define functions 
root : -» E, left, right : EF -»■ , branch : E x E u x E" -> E u 

by 

root(i) = t , left(t) = Xi.t 2 i+i, right (t) = Xi.t 2 i+2, 

x if i = 0, 

branch(x, I, r) = Xi. < i(i_i)/2 if i is odd, 
r (i-2)/2 otherwise. 

Then, for x € E and /, r € E u , 

root(branch(x, I, r)) = x, left(branch(x, I, r)) = I, right(branch(x, I, r)) = r, 
branch(root(t), left (t), right (t)) = t. 
Our experimentally faster product algorithm is then recursively defined by 

II(e)(p) = branch(x ,/o,r ) 

where 

£root = root(e), e M t = n(left(e)), e rig ht = II (right (e)), 
3ieft(p) = p(eieft(p)), 3 right (p) = p(e ri ght(p)), 
xo = e root (Xx.3 Mt l. 3 right r.p(branch(x,Z,r))), 
k = eicft(AL3 right r.p(branch(xo,/,r))), 

ro = e ri ght(Ar.p(branch(xo,Zo,0). 

The idea is that treating sequences as trees reduces some linear factors to logarithmic factors 
(very much like in the well-known heap-sort algorithm). 
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8.11. Operational perspective. An advantage of the proof of Theorem 14.61 sketched 
in [19] is that it can be directly interpreted in the operational setting [18|, 120] . The proofs of 
the other results of Section [J] are also easily seen to work in the above operational setting. 
But a development of operational counter-parts for those of later sections is left as an open 
problem. This requires an operational reworking of the topological Section which seems 
challenging. 

9. Concluding remark on the role of topology 

The algorithms developed in this work have purely computational specifications, which 
allow them to be applied without knowledge of specialized mathematical techniques in the 
theory of computation. However, the correctness proofs of some of the algorithms crucially 
rely on topological techniques. In this sense, this work is a genuine application of topology 
to computation: theorems formulated in the language of computation, proofs developed in 
the language of topology. 

But there is another sense in which topology proves to play a crucial role. Compact sets 
in topology are advertised as sets that behave, in many important respects, as if they were 
finite. Then exhaustively searchable sets ought to be compact. And compact sets are known 
to be closed under continuous images and under finite and infinite products. Moreover, for 
countably based Hausdorff spaces, they are the continuous images of the Cantor space. 
Hence searchable sets ought to have corresponding closure properties and characterization, 
which is what this work establishes, among other things, motivated by these considerations. 
Thus, in a more abstract level, topology is applied as a paradigm for discovering unforeseen 
notions, algorithms and theorems in computability theory. 
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